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to  May  31,  1986,  are  emphasized. 

y  The  main  objectives  of  this  research  have  been  the  development  of  smooth 
nonparametric  estimators  of  quantile  functions  from  right-censored  data  and  the 
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further  study  of  smooth  density  estimators  from  censored  observations.  In 
particular,  kernel-type  quantile  estimators  have  been  obtained  under  censoring 
which  give  better  estimates  of  percentiles  of  the  lifetime  distribution  than 
the  usual  product-limit  quantile  estimator.  During  the  past  year,  asymptotic 
properties  of  these  kernel  quantile  estimators  have  been  developed,  including 
asymptotic  normality,  consistency,  and  mean  square  convergence.  In  addition,  a 
data-based  procedure  for  selecting  the  bandwidth  has  been  investigated  using 
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the  bootstrap,  and  approximate  confidence  intervals  for  the  true  quantile  have 
been  proposed  using  bootstrap  estimates  of  the  sampling  distribution. 
Theoretical  results  on  the  optimal  bandwidth  selection  for  kernel  density 
estimators  under  random  right  censorship  have  also  been  obtained. 

New  results  in  several  other  problem  areas  were  also  developed.  These 
included  the  study  of  linear  empirical  Bayes  estimators,  prediction  intervals 
for  the  inverse  Gaussian  distribution,  nonparametric  hazard  rate  estimation 
under  censoring,  nonparametric  inference  for  step-stress  accelerated  life  tests 
under  censoring,  discrete  failure  models,  simultaneous  confidence  intervals  for 
pairwise  differences  of  normal  means,  and  optimal  designs  for  comparing 
treatments  with  a  control.  Work  is  continuing  on  smooth  nonparametric  function 
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estimation,  including  the  study  of  generalized  quantile  function  estimates 
under  censoring  and  the  development  of  a  theory  of  optimal  bandwidth  selection 
for  the  kernel-type  quantile  estimator  based  on  mean  squared  error  or  other 
criteria.  Exact  asymptotic  and  small-sample  confidence  intervals  for  quantiles 
are  also  under  study.  All  of  these  results  should  prove  fruitful  in  the 
assessment  of  reliability  and  maintenance  policies  of  various  types  of 
equipment. 

2.  Research  Objectives  During  the  Reporting  Period. 

The  research  objectives  of  this  project  can  be  divided  into  the  following 
categories : 

A.  NOnparametric  estimation  of  quantiles  under  censoring; 

B.  Kernel  density  estimation  from  randomly  right-censored  data; 

C.  Nonparametric  estimation  from  step-stress  accelerated  life  tests;  and 

D.  Linear  empirical  Bayes  estimation  of  mean  time  to  failure. 

The  specific  research  problems  that  were  considered  during  this  reporting 
period  in  these  areas  will  be  briefly  outlined  below.  The  results  obtained  to 
date  will  be  described  in  Section  3  of  this  report 

A.  Nonparametric  estimation  of  quantiles  under  censoring.  One  of  the  main 
objectives  of  this  research  was  to  further  develop  properties  of  smooth  non¬ 
parametric  estimates  of  the  quantile  function  from  randomly  right-censored 
data.  The  kernel-type  quantile  estimator  proposed  by  Padgett  [paper  no.  5  in 
Section  4]  was  to  be  studied  with  respect  to  its  small-sample,  as  well  as 
asymptotic,  properties.  This  estimator  smooths  the  product-limit  quantile 
function  Qn(p)  -  inf{t:  Fn(t)  >  p},  where  Fn  denotes  the  product- 
limit  estimator  of  the  lifetime  distribution  F0,  and  is  better  than  Qn(p) 


in  the  sense  of  smaller  mean  squared  errors  in  many  situations.  Thus,  such 
estimators  can  provide  more  accurate  estimates  of  percentiles,  aiding  in  the 
assessment  of  equipment  reliability. 


B.  Kernel  density  estimation  from  randomly  right-censored  data.  Another 
objective  of  this  project  during  the  reporting  period  was  to  determine  a  method 
of  "optimal"  bandwidth  selection  for  kernel-type  density  estimators  under 
random  right-censorship,  with  respect  to  some  optimality  criterion.  The  kernel 
density  estimators  of  Blum  and  Susarla  (Multivariate  Analysis-V,  1980)  and 
Foldes,  Rejto  and  Winter  (Periodica  Mathematica  Hungarica,  1980)  were  to  be 
studied. 

C.  Nonparametric  estimation  from  step-stress  accelerated  life  tests. 
Usually  in  accelerated  life  tests,  items  are  put  on  test  at  several  accelerated 
stresses  and  observed  until  failure  or  until  the  test  terminates.  A  more 
realistic  method  is  to  place  items  on  test  and  allow  the  stress  levels  to 
change  at  preassigned  times.  This  will  result  in  more  failures  in  general. 

The  objective  of  the  research  in  this  area  was  to  obtain  a  strongly  consistent 
nonparametric  estimator  of  the  unknown  life  distribution  at  the  normal  use 
stress.  A  rescaling  technique  was  utilized  to  study  this  problem. 

D.  Linear  empirical  Bayes  estimation  of  mean  time  to  failure.  In  esti¬ 
mating  the  mean  lifetimes  of  n  independent  problems,  it  is  hoped  that  the 
linear  empirical  Bayes  estimators  will  converge  to  the  optimal  linear  Bayes 
estimators  with  reasonable  rapidity.  This  convergence  was  to  be  studied  here. 
Also,  another  objective  in  this  area  was  to  identify  a  natural  class  of  esti¬ 
mators  between  the  linear  Bayes  estimators  and  the  Bayes  estimators. 


3.  Status  of  the  Research  Effort 


In  this  section  a  substantive  statement  of  the  progress  and  significant 
accomplishments  towards  achieving  the  research  objectives  for  this  reportin 
period  outlined  in  section  2  will  be  given.  The  specific  research  papers 
referred  to  will  be  listed  in  section  4  of  this  report,  which  shows  the  cumula¬ 
tive  results  of  the  entire  research  project. 

A.  Nonparametric  estimation  of  quantiles  under  censoring.  Based  on  right- 
censored  data  from  a  lifetime  distribution  Fq,  a  kernel-type  estimator  of  the 
quantile  function  Q°(p)  «  inf{t:  FQ(t)  >  p},  0  <  p  <  1,  was  proposed  by 

Padgett  in  paper  number  [53  listed  in  section  4.  The  estimator  is  defined  by 
-1  l~ 

(^(p)  -  hfl  /qQh ( t ) K ( ( t— p )/^n ) dt ,  which  is  smoother  than  the  usual  product- 

A  A  A 

limit  quantile  function  Qn(p)  ■  inf{t:  Fn(t)  >  p},  where  Fn  denotes  the 
product-limit  estimator  of  Fq.  Under  the  random  censorship  model  and  general 
(but  nonrestrictive)  conditions  on  hn,  K,  and  Fq,  it  was  shown  in  [5]  that 
Qn(p)  is  strongly  consistent.  In  addition,  it  was  shown  that  an  approximation, 
Q*,  to  is  asymptotically  equivalent  to  it  with  probability  one.  The 

general  conditions  for  consistency  included  that  hn  •+  0  as  n  -»  ®,  that  K 
be  a  symmetric  probability  density  with  finite  support,  and  that  Fq  satisfy 
certain  continuity  conditions. 

During  the  past  year,  the  estimator  (^(p)  was  studied  further  and  in  much 
more  detail.  In  paper  (7]  it  was  shown  that,  under  conditions  similar  to  those 

Jc  o 

required  for  strong  consistency,  n^Q^p)  -  Q  (p)]  is  asymptotically  normally 

u 

distributed,  provided  n  hR  -»  0.  This  condition  on  hn  can  be  replaced  by 
n**hn  ■+  0  by  using  a  slightly  different  proof.  By  centering  with  the  quantity 
Q°(p,h)  -  h“^/jQ°(t)K( (t-p)/hn)dt,  an  asymptotic  normality  result  can  be 
obtained  without  the  above  condition  on  the  rate  of  convergence  of  h  to  zero. 
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Also,  using  this  type  of  centering,  the  asymptotic  normality  of  the  approxima- 
★ 

tion  was  shown.  These  last  two  results  are  contained  in  paper  number  [12]. 
In  addition,  in  [12],  mean  convergence  of  (^(p)  and  Q^(p)  were  obtained  and 
the  mean  square  convergence  was  shown.  In  particular,  an  upper  bound  on  the 
rate  of  mean  square  convergence  of  Q^p)  to  Q°(p)  was  shown  to  be 

g(n,hn)  -  0{hn  +  h^n  ^  +  (log  n/n)^  +  n  ^cfl-p)^),  where  c  is  a 
constant.  An  example  of  a  bandwidth  sequence  satisfying  g(n,hn)  ■*  0  as 
n  -*  •  is  h^  =  cr  n  ^  for  0  <  S  <  5/2  where  cr  >  0  is  a  bounded  sequence. 
The  value  of  h  minimizing  g(n,h)  was  found  to  be  of  the  form  hfl  -  Cn-5//^. 
However,  this  rate  is  not  sharp  and  further  investigation  with  respect  to  the 
asymptotically  optimal  choice  of  h  (optimal  in  the  sense  of  minimum  mean 
squared  error)  is  needed. 

Since  the  exact  mean  squared  error  has  not  been  calculated,  an  expression 
for  "optimal"  hn  minimizing  the  mean  squared  error  is  not  available.  Hence, 
a  study  of  the  effect  of  varying  the  bandwidth  was  done  by  Monte  Carlo  simula¬ 
tions  in  paper  [15].  Five  common  life  distributions,  two  different  censoring 
distributions,  and  three  different  kernel  functions  were  used  in  the  extensive 
simulations.  The  results  indicate  that  at  fixed  p  the  kernel  estimator 
Qn(p)  has  smaller  mean  squared  error  than  the  product-limit  quantile  estimator 

A 

(^(p)  for  a  range  of  values  of  the  bandwidth  hn>  In  addition,  in  [15]  a 
method  of  selecting  an  "optimal"  bandwidth  value,  in  the  sense  of  small  esti¬ 
mated  mean  squared  error,  based  on  the  bootstrap,  was  investigated.  The 
results  were  consistent  with  the  simulation  study.  Hie  bootstrap  was  also  used 
to  obtain  interval  estimates  of  Q°(p)  after  determining  a  value  of  hn  to 
use  in  computing  Qn(p). 
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B.  Kernel  density  estimation  from  randomly  right-censored  data. 

The  problem  of  asymptotically  optimal  selection  of  the  bandwidth  sequence  for 

kernel  density  estimators  under  censoring  was  studied  in  paper  number  [13]. 

_1  00 

The  usual  kernel  density  estimator  f  (x)  -  h  J  K((x-t)/h  )dF  (t)  and  the 
Blum-Susarla  estimator  given  by  f*(x)  - 

[nh  H*(x)  ]-1  ,K((x-X.  )/h  )  •  IfA  n  were  considered,  where  H*  denotes 

n  n  ]=i  j  n  n 

an  estimator  of  the  censoring  survival  function,  (Xj,Aj),  j-l,...,n,  denote 
the  right-censored  data,  and  I^j  denotes  the  indicator  function  of  the 
event  [ • ] .  Two  important  contributions  to  the  theory  of  bandwidth  selection 
for  kernel  density  estimators  under  right  censorship  were  made  in  this  paper. 
First,  an  asymptotic  representation  of  the  integrated  squared  error  of  each 
estimator  in  terms  of  easily  understood  variance  and  squared  bias  components 
is  given.  Second,  it  is  shown  that  if  the  bandwidth  is  chosen  by  the  data- 
based  method  of  least  squares  cross-validation,  then  it  is  asymptotically 
optimal  in  a  compelling  sense.  A  by-product  of  the  first  part  is  an  interest¬ 
ing  comparison  of  the  two  kernel  density  estimators  which  shows  that  the 
difference  between  the  two  is  typically  not  negligible. 

C.  Nonparametric  estimation  from  step-stress  accelerated  life  tests. 

In  accelerated  life  testing,  items  are  subjected  to  greater  stress  than  that 
under  the  normal  use  conditions  and,  from  the  resulting  failure  data,  am 
estimate  of  the  lifetime  distribution  (or  other  inferences)  under  the  normal 
use  conditions  is  obtained.  Most  of  the  published  work  on  inference  from 
accelerated  life  tests  require  at  least  one  of  the  following  restrictions: 

(i)  that  every  item  which  is  subjected  to  an  overstress  is  observed  until  it 
fails  or  is  removed  (censored)  under  constant  application  of  the  stress,  or 

(ii)  that  the  lifetime  distribution  of  the  items  under  every  accelerated 


stress  level  is  assumed  to  be  known  except  for  the  underlying  parameters.  A 
more  realistic  approach  allows  the  stress  on  an  unfailed  item  to  change  at  a 
preassigned  test  time.  This  approach  is  used  in  government  defense  studies 
and  is  referred  to  as  step-stress  testing. 

In  paper  number  [11]  step-stress  testing  is  considered  from  a  nonparametric 
point  of  view  when  the  observations  have  been  arbitrarily  right  censored, 
relaxing  both  restrictions  (i)  and  (ii)  above.  Thus,  no  assumptions  are  made 
about  the  particular  form  of  the  underlying  lifetime  distribution.  Using  a 
rescaling  method,  an  estimator  of  the  life  distribution  under  the  normal  use 
conditions  is  obtained.  The  estimator  is  shown  to  be  strongly  consistent. 

D.  Linear  empirical  Bayes  estimation  of  mean  time  to  failure.  In  paper 
[10],  it  has  been  successfully  established  that  not  only  the  linear  empirical 
Bayes  estimator  approaches  the  optimal  linear  estimator  with  probability  one, 
but  also  in  the  quadratic  mean  with  a  rate  of  convergence  inversely  propor¬ 
tional  to  the  number  of  problems  considered.  The  same  is  true  for  the  mean 
squared  error  of  the  estimators.  Indeed,  the  limiting  constant  has  been 
explicitly  evaluated,  which  will  provide  a  guideline  for  the  consideration  of 
a  moderate  number  of  problems.  Effort  will  be  continued  to  study  the  moderate 
sample  properties  of  the  linear  empirical  Bayes  estimators,  and  to  identify  a 
natural  and  appropriate  intermediate  class  of  estimators. 

E.  Miscellaneous.  In  other  work,  an  invited  paper  [4]  was  written  on 
nonparametric  methodr  for  hazard  rate  estimation  from  censored  data.  This 
paper  first  reviewed  the  available  methods  in  the  literature  and  then  presented 
some  new  results  on  a  kernel-type  estimator  of  the  hazard  rate  under  random 
right  censoring.  The  Koziol-Green  (or  proportional  hazards)  model  was  assumed 
for  asymptotic  results  on  the  bias  and  mean  squared  error  of  the  kernel 
estimator. 


In  paper  number  (9],  a  comparison  was  given  of  two  prediction  intervals  for 
a  future  observation  from  the  inverse  Gaussian  distribution.  This  distribution 


arises  as  a  lifetime  model  which  is  an  alternative  to  the  lognormal  distribu¬ 
tion.  One  prediction  interval  is  exact  and  the  other  is  an  approximate  one. 
Surprisingly,  the  comparison  showed  that  the  approximate  interval  is  superior 
in  general,  since  it  always  yields  a  two-sided  interval  and  has  high  coverage 
probability  as  well  as  small  expected  length. 

In  paper  number  [14]  a  regenerative  sampling  plan  is  developed  for  the 
sequential  comparison  of  two  populations  having  positive  integral  response. 

It  is  designed  to  be  both  an  extension  and  an  improvement  of  the  play-the- 
winner  rules  for  binary  trials  in  the  sense  that  a  much  wider  variety  of 
responses  is  allowed,  the  fraction  of  inferior  selections  approaches  zero,  and 
the  play-the-winner  rule  is  contained  as  a  special  case.  Almost  sure  conver¬ 
gence  and  moment  convergence  in  the  pth  order  is  studied  for  the  fraction  of 
inferior  selections  and  for  a  maximum  likelihood  estimator  of  the  mean 
response.  A  conditional  test  of  hypothesis  is  given  for  the  binary  case. 

These  results  have  applications  in  clinical  trials  and  in  quality  control  as 
well  as  in  a  variety  of  other  sequential  situations. 

4.  Cumu3*vive  List  of  Written  Publications  in  Technical  Journals 

In  this  section,  the  research  papers  that  have  been  written  under  this 
grant  are  listed.  They  are  divided  into  four  categories:  In  print,  accepted 
for  publication,  and  in  progress.  Copies  of  the  manuscripts  and  reprints  have 
been  forwarded  to  the  Program  Manager  as  they  were  submitted  or  published. 
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81  (1986),  215-222.  • 

[6]  J.  D.  Spurrier  and  D.  Edwards,  An  asymptotically  optimal  subclass  of 
balanced  treatment  incomplete  block  designs  for  comparisons  with  a 
control.  Biometrika  73  (1986),  191-199. 


B.  Accepted  for  Publication 

[7]  Y.  L.  Lio,  W.  J.  Padgett  and  K.  F.  Yu.  On  the  asymptotic  properties 
of  a  kernel-type  quantile  estimator  from  censored  samples. 

Journal  of  Statistical  Planning  and  Inference  (to  appear). 

[8]  W.  J.  Padgett,  Nonparametric  estimation  of  density  and  hazard  rate 
functions  when  samples  are  censored.  Handbook  of  Statistics,  Vol.7, 
P.  R.  Krishnaiah,  Ed.  (to  appear). 

[9]  W.  J.  Padgett  and  S.  H.  Tsoi,  On  prediction  intervals  for  future 
observations  from  the  inverse  Gaussian  distribution. 

IEEE  Transactions  on  Reliability  (to  appear). 

[10]  K.  F.  Yu,  On  the  bounded  regret  of  empirical  Bayes  estimators. 
Communications  in  Statistics-Theory  and  Methods  ( to  appear ) . 


C.  Submitted  for  Publication 

[11]  D.  T.  McNichols  and  W.  J.  Padgett,  Inference  for  step-stress 
accelerated  life  tests  under  arbitrary  right-censorship.  Submitted 
to  Journal  of  Statistical  Planning  and  Inference. 

[12]  Y.  L.  Lio  and  W.  J.  Padgett,  Some  convergence  results  for  kernel-type 
quantile  estimators  under  censoring.  Submitted  to  Statistics  and 
Probability  Letters. 

[13]  J.  S.  Marron  and  W.  J.  Padgett,  Asymptotically  optimal  bandwidth 
selection  for  kernel  density  estimators  from  randomly  right-censored 
samples.  Submitted  to  Annals  of  Statistics. 


[14]  S.  D.  Durham  and  K.  F.  Yu,  Regenerative  sampling  and  monotonic 
branching  processes.  Submitted  to  Annals  of  Statistics. 

[15]  W.  J.  Padgett  and  L.  A.  Thombs,  Smooth  nonparametric  quantile 
estimation  under  censoring:  Simulations  and  bootstrap  methods. 
Submitted  to  Communications  in  Statistics-Simulation  and  Computation. 

D.  Research  in  Progress 

[16]  Y.  L.  Lio  and  W.  J.  Padgett,  Generalized  product-limit  quantile 
estimators. 

[17]  K.  F.  Yu,  A  linear  regression  with  unobserved  dependent  variables. 

5.  Professional  Personnel  Associated  with  the  Research  Effort 

In  addition  to  the  principal  investigator,  W.  J.  Padgett,  several  co¬ 
investigators  have  been  partially  supported  by  this  grant  since  June  1,  1984. 
John  D.  Spurrier  was  partially  supported  during  the  period  from  June  1,  1984, 
to  May  31,  1985,  and  Kai  F.  Yu  was  partially  supported  from  June  1,  1985,  to 
May  31,  1986.  During  the  summer  of  1985,  Diane  T.  McNichols,  Department  of 
Statistics,  Virginia  Polytechnic  Institute  and  State  U. ,  was  partially 
supported.  Also,  two  graduate  students  have  been  supported,  Andr£  M.  Lubecke 
during  the  summer  of  1984,  and  Y.  L.  Lio  from  August  16,  1984,  to  May  31,1986. 
Ms.  Lubecke  completed  the  Ph.D.  degree  in  August,  1985,  and  Mr.  Lio  is 
currently  working  on  his  dissertation,  having  completed  all  written  doctoral 
exams. 


6.  Interactions 

The  investigators  attended  several  meetings  and  conferences  and  gave 
(invited  and  contributed)  talks  as  follows: 

June  1,  1984,  to  May  31,  1985: 

i)  W.  J.  Padgett,  J.  D.  Spurrier  attended  the  Conference  on  Reliability 
and  Quality  Control,  University  of  Missouri,  Columbia,  MO,  June  4-8, 
1984. 
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ii)  W.  J.  Padgett  (joint  with  A.  M.  Lubecke),  "Nonparametric  maximum 
penalized  likelihood  estimation  of  a  density  from  arbitrarily  right- 
censored  data."  Annual  Meeting  of  IMS  in  Tahoe  City,  CA, 

August  21-24,  1984. 

iii)  J.  D.  Spurrier,  "The  training  of  statistical  consultants  at  the 
University  of  South  Carolina"  (invited).  Joint  Statistical  Meetings, 
Philadelphia,  PA,  August,  1984. 

iv)  D.  Edwards,  J.  D.  Spurrier,  "An  asymptotically  optimal  subclass  of 
BTIB  designs  for  comparisons  with  a  control."  Joint  Statistical 
Meetings,  Philadelphia,  PA,  August,  1984. 

v)  J.  D.  Spurrier  and  W.  J.  Padgett,  "On  discrete  failure  models." 
Spring  Regional  Meeting  of  the  Biometric  Society  (ENAR)  and  ASA  in 
Raleigh,  NC,  March  25-27,  1985. 

vi)  W.  J.  Padgett  was  the  invited  discussant  for  the  Session  on 
Reliability  and  Life  Testing,  Spring  Regional  Meeting  of  the 
Biometric  Society  (ENAR)  and  ASA  in  Raleigh,  NC,  March  25-27.  1985. 

vii)  W.  J.  Padgett,  "Some  estimation  procedures  for  quantile  and  density 
functions  from  censored  data."  AFOSR  Workshop  on  Reliability, 

Luray,  VA,  May  29-31,  1985. 

June  1,  1985,  to  May  31,  1986: 

i)  W.  J.  Padgett  gave  an  invited  talk  on  "Nonparametric  density  and 
failure  rate  estimators  when  samples  are  censored"  at  the  SREB-ASA 
Summer  Research  Conference  on  Statistics,  Boone,  NC,  June  16-21, 

1985. 

ii)  W.  J.  Padgett,  "A  kernel  type  estimator  of  a  quantile  function  from 
right-censored  data."  Joint  Statistical  Meetings,  Las  Vegas,  NV, 
August  5-8,  1985. 

iii)  K.  F.  Yu.  "A  note  on  the  bounded  regret  of  empirical  Bayes 
estimators,"  191st  Meeting  of  the  IMS,  Stoney  Brook,  NY,  June  12-13, 
1985. 

iv)  K.  F.  Yu,  "On  the  bounded  regret  of  empirical  Bayes  estimators." 
Joint  Statistical  Meetings,  Las  Vegas,  NV,  August  5-8,  1985. 

v)  K.  F.  Yu,  "On  a  renewal  theorem."  Centenary  Session  of  the  ISI, 
Amsterdam,  The  Netherlands,  August,  1985. 

vi)  K.  F.  YU  organized  and  chaired  a  session  on  Adaptive  Statistics  at 
the  Symposium  on  Adaptive  Statistical  Inference  and  Related  Topics, 
Brookhaven  National  Laboratory,  NY,  June  8-11,  1985. 

vii)  K.  F.  Yu  attended  the  NSF-CBMS  Conference  on  Nonparametric  Priors, 
University  Park,  PA,  June  3-7,  1985. 


one  article  for  the  Annals  of  Statistics  and  one  for  Sequential  Analysis. 

In  addition,  5  papers  were  reviewed  for  the  Zentrablatt  fttr  Mathematik  and  14 
were  reviewed  for  the  Mathematical  Reviews.  Also,  one  research  proposal  was 
reviewed  for  the  AFOSR  and  one  for  the  ARO. 

Professor  Padgett  was  a  member  of  the  International  Editorial  Board  of  the 
Communications  in  Statistics-Theory  and  Methods  and  was  an  Associate  Editor  of 
the  Journal  of  Statistical  Computation  and  Simulation.  In  addition,  he  was  the 
Program  Co-Chair  for  the  SRCOS-ASA  Summer  Research  Conference  in  Statistics  to 
be  held  in  Mobile,  AL,  on  June  15-20,  1986.  He  also  chaired  an  invited  paper 
at  the  Spring  Statistics  Meetings  in  Atlanta,  GA,  in  March,  1986. 


